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ABSTRACT 

Having examined the Federal Aviation Administration's 
(FAA) current program for providing field training to developmental 
and full-performance-level air traffic controllers, the General 
Accounting Office (GAO) recommends ensuring that FAA and contractor 
personnel are providing training consistently and uniformly. Further 
changes needed to ensure quality and consistency in FAA's new 
on-the-job training program are the following: (i) a limitation on 
the number of instructors working with each developmental controller; 
(2) standardization of the process used to certify controllers on 
operating positions; (3) specification of a minimum amount of time 
for refresher training; (4) enhancing methods used for refresher 
training, perhaps by increasing the use of videotapes and enhanced 
computer-based instruction; and (5) ensuring that facilities are 
providing required refresher training on backup systems. In addition, 
the GAO recommends that the U.S. Secretary of Transportation, in 
order to improve the oversight of field training, direct the FAA to 
establish milestones to ensure the timely development of the training 
tracking system and to evaluate contractor performance. (CML) 
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The Honorable James L. Oberstar, Chairman 

Subcommittee on Aviation 

Committee on Public Works and Transportation 

The Honorable Glenn M. Anderson, Chairman 
The Honorable William F. Clinger, Jr. 
Ranking Minority Member 
Subcommittee on Investigations and Oversight 
Committee on Public Works and Transportation 
House of Representatives 

The Federal Aviation Administration (faa) is responsible for trainmg 
over 16,000 air traffic controllers annually at about 420 field facilities. 
At the request of the former Chairman, and current Ranking Minority 
Member, Subconunittee on Investigations and Oversight, House Commit- 
tee on Public Works and Transportation, we examined faa's current pro- 
gram for providing field training to developmental and full performance 
level controllers.* In addition, we examined faa's planned changes to 
determine if further opportunities exist for improving the program. We 
also determined whether faa is evaluating contractor-provided training 
as required by federal regulations. (Appendix I contains our detailed 
objectives, scope, and methodology.) 



Results in Brief National Transportation Safety Board (Safety Board) has linked 

deficiencies in training to impairments in air traffic safety. We found 
opportunities to improve both the delivery and oversight of the control- 
ler field training program. Specifically, we found that (1) on-the-job 
training (OJT) provided to developmental controllers at field facilities is 
not standardized despite recent faa efforts to make it more uniform, (2) 
full performance level controllers are receiving only limited amounts of 
training to maintain and upgrade their knowledge and skills, (3) faa 
does not maintain sufficient data to oversee controller field training, and 
(4) FAA has not evaluated contractor-provided training at en route 
centers.2 



'A full performance level controller is one whMiXully certified to operate all positions in a defined 
area. jJ?** 

^En route centers provide for control and sepaj||ion of aircraft between destinations and over 
oceanic routes. A network of 20 centers is locaM in the contiguous United States. 
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FAA recognizes the need to improve its field training programs, and in 
August 1988, a series of initiatives was announced to improve controller 
training. (See app, IL) Whil^ these initiatives should strengthen r\a's 
training programs, additional changes are needed to improve both faa's 
implementation and oversight of controller field trairdng. 



Background 



Two principal types of training are provided in the field: (1) develop- 
mental training or training in the knowledge and skills needed to become 
a fully qualified controller and (2) full performance controller training, 
which is given to refresh controllers on existing procedures and intro- 
duce new ones. (See app. III.) faa uses several methods to provide this 
training including classroom, ojt, and computer-based instruction. 



Training is critical to an individual's successful performance as an air 
traffic controller and to the safety of the nation's air traffic system. The 
Safety Board has found that training deficiencies have contributed to 
controller errors at busy facilities, such as Chicago's O'Hare Interna- 
tional Airport, and in at least two cases, to aircraft accidents and 
deaths. These training deficiencies included inadequate ojt and the need 
for refresher training in fundamental and essential control procedures. 
(See app. IV.) Moreover, faa has found that over 14 percent of control- 
lers' errors occur during ojt or involve controllers forgetting procedures 
they were taught during training. 



Scope and 
Methodology 



This report is based on work at faa headquarters, the National Trans- 
portation Safety Board, and 11 faa field facilities — 5 en route centers 
and 6 terminals.^ These facilities included four pairs of high-activity 
facilities (hereafter referred to as "four matched-pairs") and three other 
facilities selected on the basis of their special training characteristics. 
We selected the four matched-pairs to determine to what extent facili- 
ties with similar characteristics had similar training programs. We also 
reviewed the results of a 1988 gao questionnaire received from 5,098 
controllers, supervisors, and managers at 84 faa facilities. 



^^erminal facilities control aircraft within the area of one or more airports. Depending on the density 
and type of air traffic involved, a terminal facility may handle operations either for the airport at 
which it is located or for acUacent airports as well. 
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FAA has announced plans to streamline the way controllers are trained in 
order to train them faster and better. These initiatives, which wili be 
ongoing through the 1990s, include training professional instructors, 
using state-of-the art training technology, and redesigning the training 
curriculum. However, these training initiatives do not address the fol- 
lowing problems we found in providing and overseeing field training. 



FAA's goal is to have a standardized training program, ojt provides 
actual air traffic control experience for developmental controllers to 
successfully qualify as a full performance level controller. Most ojt 
occurs when a developmental controller works one-on-one with an expe- 
rienced controller to learn a specific control position. To standardize this 
process and enhance it^ quality and objectivity, faa implemented new 
OJT procedures in August 1988. We found, however, that additional 
changes are needed to ensure that the standardization called for is 
achieved. 



faa's new instructor requirements are an attempt to improve the quality 
of OJT instruction by (1) increasing the experience requirement for ojt 
instructors from 30 hours on a position to 6 months working a position 
and (2) requiring a core group of instructors act each facility rather than 
allowing all eligible controllers to provide ojt, thereby being more selec- 
tive about instructors and using only those who understand how to train 
well. However, as an faa contractor study pointed out, the new system 
does not include an important requirement for a successful training pm- 
gram— limiting the number of ojt instructors working with each devel- 
opmental controller. 

The contractor reported that faa*s widespread use of multiple ojt 
instructors resulted in ineffective training because developmental con- 
trollers did not receive consistent training and benefit from having a pri- 
mary instructor to directly observe their performance over an extended 
period of time. The study stated that using a single or primary ojt 
instructor provides an environment more conducive to learning because 
developmental controllers need extended time with one ojt instructor to 
acquire good air traffic control techniques and instructors need 
extended exposure to students to competently assess performance. 

During our field visits, we found that only one of the four matched-pairs 
we rev iewed assigned a primary ojt instructor to each developmental 
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controller, while two matched-pairs assigned ojt instructors to develop- 
mental controllers solely on the basis of instructor availability. The 
fourth used both forms of assigning instructors. 



Position Certification ^ culminates in the position certification process, which is a technical 

Process appraisal of an individual's ability to control air traffic. At certification, 

all developmental controllers should have comparable knowledge, skills, 
and abilities, faa headquarters officials recognize the need for a stan- 
dardized method of certifying developmental controllers on specific 
operating positions to achieve this comparability. To increase objectiv- 
ity, FAA issued a new ojt order in August 1988 that removed the evalua- 
tion responsibility from ojt instructors to third parties. However, the 
new order does not specify the exact position certification process to be 
followed. Consequently, the service provided to pilots continues to be 
inconsistent from facility to facility depending on the controller operat- 
ing a position. 

Facilities we visited used several different methods to conduct position 
certifications, and these evaluations lasted from 1 to 4 hours. Half of the 
facilities required that first-line supervisors certified on the position 
being appraised conduct the performance evaluation. The other half did 
not. Their methods included developmental controllers being certified 
without an evaluation. For example, at one facility, as part of the certi- 
fication process, supervisors certify developmental controllers after 
reviewing their individual training records without observing 
performance. 



FAA requires that full performance level controllers receive training on a 
recurring basis at field facilities to maintain and upgrade their knowl- 
edge and skills. The bulk of it is called **refresher training.** (See app. 
HI.) During our field visits, we found that refresher training is inconsis- 
tent in terms of the amount and method of instruction and, in light of 
the Safety Board's findings, may not ensure that controllers know how 
to operate backup air traffic control systems or remember new 
procedures. 

In 1989, FAA plans to develop 10 core training courses for full perform- 
ance level controllers, which it expects to begin using in early 1990. This 
effort, generally supported by managers at facilities we visited, should 
provide some level of standardized training. However, since faa has not 
yet developed and tested these core courses, we could not determine 
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whether this initiative will correct the problems we found with 
refresher training. 



Amount of Training ^^^^ facilities are required to develop and administer annual refresher 

training programs that include training on unusual situations and sel- 
doni-used procedures because they train controllers on procedures and 
techniques that are essentia! for job requirements, but are not routinely 
used. Prior to the 1981 controllers' strike, faa required that facilities 
provide 40 hours of training to each full performance level controller 
annually. In order to focus on developmental controller training, this 
specific 40-hour requirement was deleted from the national training 
order shortly after the strike; facilities are now given discretion to 
establish their own requirements. Headquarters officials believe it 
would be difficult to reestablish a national requirement for a specific 
amount of training primarily because facilities of different sizes do not 
require the same amount of training; and, consequently, a certain 
amount of flexibility is needed. 

We found that the facilities we visited established different require- 
ments and accomplished varying amounts of refresher training. Only 
one of the four matched-pairs required a similar amount of refresher 
training per controller— zero to 2 hours. The remaining three had differ- 
ent requirements ranging from 2 to 18, zero to 16, and 2 to 12 hours, 
respectively. Actual experience showed that only one matched-pair pro- 
vided about the same amount of refresher training in fiscal year 1987; in 
contrast, one matched-pair provided 53 and 8 hours of training, respec- 
tively, per controller. (See table III.l.) 

Further, in response to our 1988 survey of the controller work force, a 
majority of first-line supervisors responded that the amount of training 
was less than needed in areas of backup systems, simulation lab, and 
annual specialized training (airspace maps, facilities' operating proce- 
dures, etc.). (See table III.2.) Managers at the facilities we visited 
believed that this training has been limited, in part, because faa's 
emphasis on developmental controller training and staffing shortages at 
some facilities has made it difficult to free controllers from worldng at 
control positions to attend classroom sessions. Headquarters officials 
agreed with this assessment. 



Method of Training addition to facilities providing different amounts of refresher train- 

ing, such training is mainly accomplished through self-study reading 
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material and as part of supervisor briefings of their staff, rather than 
through formal instruction (classroom, simulator, or computer-based). 
We found that two of our four matched-pairs did not provide any class- 
room training in fiscal year 1987; one provided a limited amount (a max- 
imum of 16 hours per controller); and the remaining pair was split 
between providing zero and a limited amount (4 hours). One facility 
manager expressed concern that **do it yourself refresher training 
allowed differing interpretation of information. 

The contractor that evaluated faa's training program referred to 
refresher training as a "perfunctory paper drill." The contractor stated 
that operational errors occurred because of inadequate refresher train- 
ing and said that the best way to improve this training and reduce these 
errors is with improved refresher training methods (e.g., videotapes and 
enhanced computer-based instruction). Further, the Safety Board in its 
investigations of controller errors, found that even experience " control- 
lers are not as familiar with facility procedures as they should be. For 
example, in November 1988, it reported that a senior radar controller 
committed an error involving the Presidential aircraft, in part because 
he was not familiar with facility procedures for separating and transfer- 
ring aircraft—procedures taught and reemphasized during refresher 
training. (See app. IV.) 

FAA headquarters officials stated that a "total overhaul" of refresher 
training is needed but explained that some of the field's current infor- 
mal training methods are used in an effort to do the best they can 
because resources are not available at all facilities to provide f onnal 
instruction. 



Data to Oversee Field ^^a headquarters officials recognize that they do not have the informa- 

Training Is Insufficient ^^^^ needed to oversee field training and have supported establishment 

of a training tracking system since October 1987. They believe such a 
system would provide ways to compare training programs between 
facilities by measuring pass/fail rates, momtoring ojt instructor per- 
formance, and projecting developmental staffing needed to achieve 
desired full performance controller staffing levels. However, faa head- 
quarters does not track full performance level controllers training. 

Currently, faa requires facilities to submit some training data on devel- 
opmental controllers to its Civil Aeromedical Institute, which uses the 
data to ensure that initial training at the faa Academy does not, among 
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other things, discriminate against minorities. However, faa headquar- 
ters officials and a contractor that reviewed faa's training system said 
these data are incomplete. For example, the system does not contain 
information on transferred developmental controllers or on recently 
hired former military controllers. Therefore, pass/fail rates and hours of 
training for these and all other controllers that are important to judge 
the quality of facility training and to determine whether faa is achiev- 
ing its goal of providing standardized instruction are not included. 

Although training branch officials had hoped to develop the system by 
late summer 1989, in February 1989, they indicated that system devel- 
opment has been delayed to a large extent until fall 1989. Delays are 
occurring, among other things, because of (1) turnover of personnel in 
the responsible branch, (2) hardware and software acquisitions, (3) 
installation of training records in the system, (4) coordination between 
FAA offices that will use the data, and (5) security of the system. The 
system is expected to include information discussed above on both 
developmental and full performance level controllers. 

Having one tracking system may also reduce the effort now devoted by 
facilities we visited in maintaining their own developmental controller 
tracking systems. However, none of these facilities forwarded their data 
to FAA headquarters or tracked full performance level controller 
refresher training. 



FAA Has Not Evaluated 
Contractor Training ac En 
Route Centers 



FAA is using contractors to provide classroom and laboratory training to 
developmental controllers at all en route centers. From April 1986 
through January 1989, faa spent about $55 million for this service, faa 
plans to continue contractor training until at least 1994 and is 
expanding it to several terminal facilities. (See app. V.) However, faa 
has not evaluated the training contractors' performance as required. 

Federal Acquisition Regulations and the contracts' statements of work 
provide for agencies to perform actions necessary to ensure that con- 
tractor services meet contract specifications. The contracting officer or 
technical representative is responsible for evaluating contractor per- 
formance at each en route center. According to the contracting officer's 
technical representative, budget constraints, including faa's absorption 
of the 4-percent federal pay raise, have prevented faa from performing 
these evaluations. In addition, from June 1987 through March 1988, air 
traffic officials made some observations on contract instruction during 
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their evaluations of centers' training programs. However, these evalua- 
tions have also been suspended because of resource constraints. In Janu- 
ary 1989, FAA officials said that they plan to evaluate contractor 
performance on the new contracts. They also attend to more actively 
compete for resources to perform these evaluations. 

Field management has varying concerns with contractor training. For 
example, officials at two centers we visited were dissatisfied with con- 
tractor-provided training, citing problems with (1) instructors not being 
as familiar as they should be with current procedures and equipment 
and (2) field managers being unable to take corrective action when poor 
instructor performance is identified.'* The other three centers were gen- 
erally satisfied with contractor trainiiig but also noted that instructors 
are not up-to-date on procedures. In addition, a majority of center mana- 
gers responding to our recent questionnaire believed that faa should let 
the training contracts lapse. (See app. VI.) Contract evaluations could 
help FAA headquarters to determine why managers feel this way and to 
judge the effectiveness of contractor training and the corrective actions 
needed to make the program more effective. 

faa's current controller training contracts expired at the end of January 
1989. On January 31, 1989, faa issued new contracts to the same con- 
tractors for up to 5 years at an estimated cost of $ 1 20 million, faa plans 
to expand the use of contractors to other terminal facilities similar to 
that done at Chicago, Los Angeles, and Oakland. However, faa does not 
plan to evaluate contractor-provided training in fiscal year 1989. 



Conclusions controller field training is to be effective and responsive to the 

agency's needs, i aa must ensure that faa and contractor personnel are 
providing training consistently and uniformly, faa recognizes the need 
for more standardization in field training, but its training initiatives do 
not fully address the issue. Further changes are needed to ensure qual- 
ity and consistency in faa*s new ojt program by (1) limiting the number 
of OJT instructors working with each developmental controller and (2) 
standardizing the process used to certify controllers on operating posi- 
tions. Although using primary ojt instructors may be difficult for under- 
staffed facilities, we believe that the number of instructors per 
developmental controller should be reduced to the extent possible. 



■^Under the contracts' tenns, the contracting officer may dismiss a contract instructor. 
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FAA also needs to better ensure that full performance level controllers 
receive the training needed to maintain and upgrade their knowledge 
and skills. To do this, faa needs to provide a minimum amount of 
refresher training to each controller, and use training methods that will 
enhance learning. Increasing the use of videotapes and enhanced com- 
puter-based instruction would be one way to do this. 

FAA headquarters does not now have the information needed to oversee 
controller field training but plans to develop a new training tracking 
system. We believe that developing and implementing a tracking system 
as soon as possible is crucial because when this system is fully imple- 
mented, r\a's oversight of training should improve. 

In addition, faa needs to improve its oversight of contractor-provided 
training at en route centers, faa has not evaluated contractor perform- 
ance even though the program is being expanded to selected terminal 
facilities. While we recognize that faa believes budget and other con- 
straints have limited its ability to evaluate contractor-provided training, 
oversight of such training is fundamental to good management prac- 
tices. Moreover, since controller training is critical to a safe national air 
traffic system, it is imperative that the training being provided is of 
high quality. 



To improve controller training programs, we recommend that the Secre- 
tary of Transportation direct the Administrator, faa, to 

revise its training orders to (1) limit, to the extent practicable, the 
number of instructors per developmental controller, (2) establish a uni- 
form process for conducting controller certification evaluations, and (3) 
specify minimum time requirements for refresher training hours; 
ensure that facilities are providing required refresher training, such as 
training on backup systems; and 

enhance refresher training methods for full performance level control- 
lers. One way of doing this would be to increase the use of videotapes 
and enhanced computer-based instruction. 

Further, to improve its oversight of field training, we recommend that 
the Secretary of Transportation direct the Administrator, faa, to (1) 
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establish milestones to ensure the timely development and implementa- 
tion of the training tracking system and (2) evaluate contractor per- 
formance, in view of the additional funds committed for contractor- 
provided training. 



As agreed with your office, we did not obtain official agency comments 
on a draft of this report. However, we did discuss its contents with offi- 
cials at FAA headquarters and the National Transportation Safety Board, 
who agreed with the information presented, and we have incorporated ' 
their views where appropriate. 

Unless you publicly announce its contents earlier, we plan no further 
distribution of this report until 15 days from the date of this letter. At 
that time, we will make copies available to the Secretary of Transporta- 
tion; the Administrator, faa; interested congressional committees; and 
others. This work was conducted under the direction of Kenneth M. 
Mead, Director, Transportation Issues. Major contributors to the report 
are listed in appendix VII. 
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Objectives, Scope, and Methodology 



On September 21, 1987, the former Chairman and current Ranking 
Minority Member, Subcommittee on Investigations and Oversight, House 
Committee on Public Works and Transportation, requested that we 
examine faa's current program for providing field training to develop- 
mental and full performance level controllers. In addition, we examined 
FAA's planned changes to determine if further opportunities existed for 
improving the program. We also determined whether faa is evaluating 
contractor-provided training as required by federal regulations. 

This report is based on work at faa headquarters, the National Trans- 
portation Safety Board, and air traffic facilities in five faa regions. 
These facilities formed the basis of our matched-pair analysis— a com- 
parison of the organization, conduct, and success of training programs 
at four pairs of faa facilities. Three additional facilities were selected to 
obtain an understanding of specific training issues (Seattle center and 
North Philadelphia and Atlantic City airport terminals^ ). 

To select the four matched-pairs, we used data from faa's Personnel 
Management Information System and faa's fiscal year 1986 air traffic 
activity report. We used the personnel system data to compare the mid- 
fiscal-year (Mar. 31, 1988) number of on-board full performance level 
controllers with total controller staffing at each of the busiest air traffic 
facilities.2 We used the activity report to compare facility air traffic 
levels. We then analyzed the data to find pairs of facilities with similar 
characteristics, and judgmentally selected eight facilities (four pairs) 
according to: the percentage of on-board full performance level control- 
lers, level of air traffic activity, facility type and level, and faa region as 
shown in table I.l. The purpose of selecting pairs of facilities was to 
determine to what extent facilities with similar characteristics had simi- 
lar training programs. 



Seattle center is using a unique radar-training program for developmental controllers. North Phila- 
delphia and Atlantic City terminals are examples of smaller facilities that must constantly retrain 
controllers since they lose fully qualified controllers to larger facilities because of promotions. 

-All level 2 and 3 centers and terminal facilities with at least 60 radar operations per hour (level 4 
and 5). 
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Table 1.1: Matched-Pair Faciiities Visited 
byQAO 





Percent of f uli 






Paired faciiity 


performance 


1986 air traffic 


Faciiity 


controiiere 


operations 


ievel FAA region 


Centers: 


Fort Worth 


73 


1,759,054 


3 Southwest 


Houston 


72 


1,641,786 


3 Southwest 


Oakland 


51 


1,472,395 


3 Western- 


Los Angelos 


54 


1,651,367 


3 Pacific 


Terminals: 


Pittsburgh 


76 


483.104 


5 Eastern 


Washington 


72 


489,730 


5 Eastern 


(National 








Airport) 








Dayton 


66 


331,336 


4 Great Lakes 


Cleveland 


62 


335,926 


4 Great Lakes 



To determine how field training is provided to developmental and full 
performance level controllers, we reviewed internal evaluations that 
were available for the facilities we visited. At each facility, we analyzed 
data on training resources (personnel and equipment), training work 
load, and tracking systems. We reviewed a sample of individual training 
records to determine (1) whether facilities are providing OJT to develop- 
mental controllers in accordance with national requirements ai d (2) 
how much refresher training is being provided to full performance level 
controllers. 



Further, we determined methods used by each facility to provide (1) ojt 
and refresher training and (2) conduct control position certification 
evaluations. We also obtained available facility data from faa's Civil 
Aeromedical Institute on training success rates and average time in 
training before achieving the full performance level. 

We interviewed facility management on all of these issues, and obtained 
their views on center contract training and relevant faa initiatives (new 
OJT order, new operational position standards, and facility-specific radar 
training). We also interviewed controllers about developmental and full 
performance level controller training at their facilities. 

We also reviewed available documentation on (1) faa's justification for 
its contracts for en route center training, (2) contract specifications and 
modifications, (3) periodic contractor reports submitted to faa head- 
quarters, (4) efforts to conduct contract evaluations, and (5) faa's long- 
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term plans for the contracts. We interviewed faa headquarters officials 
on all of these issues. We also reviewed a Department of TransportPtion 
Inspector General report (No. AV-FA-8-029, June 7, 1988) on the 
contracts. 

To help us identify opportunities for improving faa's field training pro- 
grams and to minimize duplication of effort, we reviewed the final 
reports from two faa contractors who recently evaluated faa's air traf- 
fic training programs. We also reviewed available documentation on a 
series of initiatives announced by faa's Administrator in August 1988 to 
revamp the way faa trains air traffic controllers. (See app. I!.) Finally, 
to assess the relationship between training and controller errors and/or 
aircraft accidents, we interviewed National Transportation Safety Board 
officials and reviewed training-related reports. (See app. IV.) 

To determine perceptions of current field-training effectiveness, we 
relied primarily on our analyses of responses to training questions in our 
1988 questionnaire survey of (1) full performance level and develop- 
mental controllers certified on at least one radar position, (2) first-line 
supervisors, and (3) facility managers at 84 facilities. (See app. VI.) 
These facilities were the 20 en route centers in the continental United 
States and the nation's 64 largest terminal facilities. The 1988 survey 
included questions from our 1985 survey, as well as questions on new 
topics, such as morale, airline scheduling, and airline hubbing. Of 6,469 
questionnaires distributed, we received 5,098 responses, for an overall 
return rate of 79 percent. Details of our questionnaire procedures, sam- 
pling methodology, and tabulated survey results are contained in a sepa- 
rate report that we expect to issue in the near future. 

Our work included a limited review of faa's internal controls related to 
controller training. We reviewed Transportation's and faa's internal con- 
trol reports submitted in response to the Federal Managers Financial 
Integrity Act of 1982, which did not identify any weaknesses in this 
area. 

We conducted our review from March through November 1988, and 
updated selected data as of February 1989. Our review was performed 
in accordance with generally accepted government auditing standards. 
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FAA Training Initiatives 



On August 5, 1988, faa*s Administrator announced that faa was 
embarking on an ambitious evaluation to upgrade and modernize its air 
traffic controller training program. This evaluation was the culmination 
of almost a year of study on the part of faa and two contractors. faa*s 
evaluation was done in two stages — (1) completion of studies and (2) 
consensus building and review of recommended changes by faa officials. 



Contractor and In- 
House Evaluations 



In Sepuember 1987, faa, working through the Office of Personnel Man- 
agement, awarded a contract to examine its controller training program. 
Two projects were undertaken — to design the next generation of the air 
traffic training system and to examine the current management of con- 
troller training. Reports on these issues were completed in May and June 
1988. 



In November 1987, faa formed an in-house task force called the faa 
Technical Training Review Group to examine how well it manages its 
technical training for controllers, inspectors, and maintenance techni- 
cians. This task force had a broad charter to look at training require- 
ments, training costs, material acquisition, delivery and preparation of 
training, and staffing for the administration of training. It issued a final 
report and recom.^endations in March 1988. 



BuildinS Consensus ^^^^ 19SS^ when the contracted studies were completed, faa began 

^ synthesizing the recommendations of these three evaluations to deter- 

mine what changes made the most sense and could be implemented. Two 
groups were eventually formed — one for air traffic training and another 
for flight standards and airway facilities training.* 

In late July 1988, these groups completed a paper defining nine major 
training initiatives which were announced by the Administrator in 
August. These initiatives included 

• establishing an Office of Training; 

• establishing a national recruitment program; 

• establishing a new relationship with academia and industry; 



* Aviation standards is the organization for FAA s aviation safety inspectors; airway facilities is the 
organization forFAA's maintenance personnel. 
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• developing a new air-traffic-screening program;^ 

• improving ojt; 

• improving the training curricula offered by faa; 

• upgrading the technology available at the faa Academy; 

• expanding the role of faa's Center for Management Development in pro- 
viding executive training; and 

• establishing an Institute for Human Resources Research to improve 
faa's research in the areas of selection, training, human performance, 
and human factors. 

Since August, faa has been (1) defining specific projects that would 
implement these initiatives and (2) refining cost estimates for these 
projects. In October 1988, faa reorganized its training organization and 
created an Office of Training and Higher Education to elevate the status 
of training within faa and improve management of training. 



Msgor Initiatives 
Affecting Controller 
Field Training 



Of the nine initiatives announced by faa, two have particular signifi- 
cance for controller field training— improving ojt training and improv- 
ing the training curricula. The ojt initiative is to be completed in three 
phases. Phase I, described in this report, will enhance existing require- 
ments and courses. Phase II will develop new courses for both ojt 
instructors and examiners. Phase III will provide for course revisions as 
a new curriculum for air traffic is implemented. Phase III is scheduled 
for completion in March 1992. 

The new air traffic curriculum will expand the use of simulators, pro- 
vide more site-specific training, and add more basic training at the Acad- 
emy for terminal controllers, faa also plans to (1) redesign the training 
curriculum to better teach the thought processes and skills needed by 
controllers, (2) develop a full performance level controller training cur- 
riculum, and (3) establish radar training centers throughout the country. 
These projects will be implemented through 1994. faa is also developing 
a curriculum for facility managers, training administrators, and evalu- 
ators to help them provide better management of the training program. 



^Air traffic screening includes the OfHce of Personnel Management aptitude test, and the initial 11- 
wefik program of instruction and testing that controller candidates undergo at the FAA Academy in 
Oldahoma City, Oklahoma. 
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Since a m^jor focus of faa's initiatives is to modernize field training and 
replace labor-intensive training methods with simulation and state-of- 
the-art technology, we discussed the initiatives with faa field personnel 
and National Transportation Safety Board officials. We found that both 
field personnel and the Safety Board support the need to modernize con- 
troller training. 

Specifically, we found that in response to our recent survey of facility 
managers, more than half who responded believed the amount of simu- 
lator equipment at their facilities is inadequate. (See app. VI.) The 
Safety Board also reported in its investigation of controller errors at 
Chicago's O'Hare International Airport that faa needed to upgrade its 
simulator equipment. It said that equipment limitations resulted in 
unrealistic simulation problems that did not reflect the airport's actual 
traffic conditions. In addition, field managers also generally agreed with 
faa's initiative to expand the use of facility-specific radar training.^ 



Field Personnel 
Support FAA'S Efforts 
to Improve Controller 
Training 



^Facility*specific radar training allows developmental controllers to train on airspace they will con- 
trol at their home facility, and uses problems from that facility. Under the usual (or generic) radar- 
training program, developmental controllers are instructed on fictional airspace. 
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FAA's Training for Developmental and Full 
Performance Level Controllers 



To train air traffic controllers, faa havS established a training program 
with many directives and guidelines. Ck)ntrollers receive initial training 
at the FAA Academy and then are assigned to the field for training to the 
full performance level. On average, it takes 2.8 years to train a control- 
ler to the full performance level, from entry into the faa Academy to 
completion of training. 



Air traffic controllers begin their training at the faa Academy in 
Oklahoma City, where they are enrolled in an 1 1-week program . 
designed to screen out those without the potential to become full per- 
formance level controllers. Academy graduates are assigned to faa field 
facilities. Except for this initial training at the Academy and a subse- 
quent return for an introduction to radar, most controller training 
occurs at the trainees' assigned facilities. 

FAA has established Instructional Program Guides for centers and termi- 
nals that outline training program requirements. Additional guidance is 
provided in three faa orders: 

• National En Route and Terminal Air Traffic Training Programs (order 
3120.18A), 

• Air Traffic Training (order 31 20.4G), and 

• Air Traffic Control Specialist On-The-Job Training and Position Certifi- 
cation (order 3120.24). 

Field training at centers includes classroom and simulator training pro- 
vided by contract personnel, and OJT provided by faa controllers. The 
training program consists of 13 phases as a controller progresses from 
the entry level to the full performance level. Developmental controllers 
must achieve a specified level of performance before proceeding to the 
next phase. Field training at terminals, provided primarily by faa per- 
sonnel, includes classroom and simulator training, and ojt instruction. 
The terminal training program consists of 1 1 phases designed to accom- 
modate the needs of various levels of terminal facilities. 



Once controllers become fully qualified, faa provides them with profi- 
ciency training, which is required to maintain and upgrade the knowl- 
edge and skills necessary to apply air traffic procedures in a safe, 
orderly, and expeditious manner. Three types of full performance level 
controller (or proficiency) training exist: (1) periodic refresher training 
on topics such as unusual situations (e.g., handling traffic in bad 



FAA's Developmental 
Ciontroller Training 



FAA's FuU 
Performance Level 
Controller Training 
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weather or hijack situations), (2) supplemental training required when 
significant changes in procedures occur, and (3) remedial training used 
to correct an individual's operational deficiencies. 

Most of the full performance level controller training provided by field 
facilities is refresher training, which is designed to ensure that control- 
lers remain at their operational peak. While controllers control traffic 
continuously, there may be extended periods of time when they do not 
employ some procedures and techniques in which faa requires them to 
be proficient. Thus, refresher training shouM occur periodically and, at 
a minimum, cover those areas that may be infrequently encountered on 
position but are essential for optimum perfonnance, 

FAA does not have a standard refresher training program; rather, it pro- 
vides general guidance for field facilities to use in developing and 
administering their own local refresher training programs. This guid- 
ance, contained in faa order 3120,4G, includes the following: 

• Training for ( 1) unusual situations, such as aircraft equipment failure, 
hyacking, and other types of emergencies, (2) seldom used procedures, 
such as those for separating aircraft without using radar. (3) traffic and 
safety advisories, and (4) areas identified as needing reinforcement, 

• At least 2 hours of simulation training on the above topics for facilities 
with simulation capability, 

• Quarterly training in lost aircraft orientation. 

• Semiannual training on techniques for applying nonradar procedures or 
operating with backup equipment. 

Table 111,1 summarizes refresher training requirements contained in 
facility training orders, as well as the average amount of refresher train- 
ing provided to each full performance level controller in fiscal year 1987 
for each of our four matched-pairs. 
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.Table ilLI: Refresher Training 
Requirements and Amount Provided in 
Fiscal Year 1987 







Average 






hours 


Paired facilities 


Hours required per controller 


provided 


Centers:® 


Fort Worth 


16 classroom and 2 simulator 


53 


Houston 


2 simulator 


7 


Los Angeles 


2 simulator 


9 


Oakland 


Required, but amount unspecified 


3 


Terminals: 


Pittsburgh 


40 proficiency, refresher unspecified 


18 


Washington 


Required, but amount unspecified 


19 


(National 




Airport) 






Cleveland 


2 simulator 


29 


Dayton 


Required, but amount unspecified 


35 



-L/enier oaia are ror one area or operaiion wiinin eacn raciiiiy. we seiecteo me area witn tne nignest 
number of full performance level controllers at the time of our visits. 

As shown in table III. 2, a majority of the 939 first-line supervisors who 
responded to our recent questionnaire believe that the amount of full 
performance level controller training at their facilities was less than 
needed in the areas of backup systems, simulation lab, and annual spe- 
cialized training. 





Table 111.2: Supervisors' Views on Amount of Full Perfonnance Level Controller Training 


Figures in percent 




Much less 
than needed 


Somewhat 
less than 
needed 


About the 
right amount 


Somewhat 
more than 
needed 


Much more 
than needed 


No basis to 
judge/don't 
know* 


DARC/other backup systems 


27 


40 


30 


1 


1 


7 


Simulation (DYSIM/ETG) lab 


33 


31 


31 


3 


2 


8 


Annual specialized training (map, operating 
procedures, letters of agreement, etc.) 


22 


34 


39 


4 


2 


1 


Computer-based instruction 


22 


25 


39 


8 


6 


6 


OJT instructor performance evaluation 


12 


24 


53 


7 


4 


1 


Tape monitor review 


5 


17 


64 


10 


5 


0 


Over-the-shoulder evaluation 


2 


11 


73 


9 


5 


0 



Question. For each of the following types of FPL (full performance level controller) proficiency training 
that FPLs have received, is the amount of training more or less than needed, or is it about the right 
amount? If you work at sn enroute center answer for your area of specialization; if you work at a terminal 
answer for your schedule 

^Response to this answer was not copoidered in caicuiating percentages for other response categories. 
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Controller Training Problems Identified by the 
National Transportation Safety Board 



The National Transportation Safety Board is responsible for investigat- 
ing and making safety recommendations on all civilian aviation acci- 
dents and other aviation safety problems. The Safety Board has found 
that inadequate faa training has caused controllers to conunit errors. 
The Safety Board has recommended improvements in faa's controller 
training because, in some cases, these errors have contributed to aircraft 
accidents and loss of life. 



Training and Aircraft 
Accidents 



The Safety Board found that controller training deficiencies contributed 
to loss of life in midair collisions in Independence, Missouri, on January 
20, 1987, and Orlando, Florida, on May 1, 1987. For example, it found 
that improved radar training for controllers would have prevented the 
accidents. In the first accident, the Safety Board predicted that cata- 
strophic accidents at certain locations may occur in the next 10 to 12 
years if improvements are not made to upgrade radar equipment and 
training. The Safety Board also reconunended that an ad-hoc task force 
be established to develop improvements in the radar portions of devel- 
opmental and full performance level controller training. 



Controller errors have been a mgjor concern of the Safety Board, which 
has issued several reports including: a report of Runway Incursions at 
ControUed Airports in the United States , dated May 6, 1986; reports on 
Chicago's O'Hare International Airport, dated May 27, 1986, February 6, 
1987, and August 8, 1988; and a report involving Air Force One, dated 
November 15, 1988. 

The Safety Board stated in its 1986 report on runway incursions that 
FAA controllers did not have the best available training in certain duties. 
Deficiencies in their training were cited as long-term and would require 
a dedicated effort by faa to correct. According to the Safety Board: 

**The FAA should reexamine the on-the-job training controllers receive and review 
the qualifications of the instructor to ensure that on-the-job training is given, when- 
ever possible, by experienced and motivated full performance level controllers 
rather than by developmental controllers or full performance level controllers, who, 
while highly qualified, may not have had many hours of experience at a certain 
position.** 



Training and 
(Controller Errors 



In its O'Hare airport reports, the Safety Board reported that generally, 
most errors indicated basic controller performance flaws that should 
have been identified and corrected through proficiency training before 
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they contributed to errors. In its latest report on the O'Hare airport, 5 of 
12 recommendations were related to controller training. For example, 
the Safety Board recommended that O'Hare implement a back-to-basics 
program including refresher training in fundamental and essential con- 
trol procedures, and require that all radar controllers complete the 
course content. It also reported that 

. . a lack of quality OJT instruction may, on occasion, exist today at O'Hare and 
compromise the total training effort . . . such conditions could be responsible, 
directly or indirectly, for an increase in operational errors.*' 

In its November 1988 report on an error involving Air Force One and a 
commercial airliner, the Safety Board reported that deficiencies in profi- 
ciency training and other operational areas contributed to the error. Ttie 
proficiency training deficiencies included lack of refresher training on 
seldom used procedures, and traffic and safety advisories. For example, 
a senior radar controller committed an error, in part, because he was not 
familiar with facility procedures for separating and transferring air- 
craft. These procedures are taught during reiresher training. 

The Safety Board was also particularly concerned that these deficiencies 
had been identified by internal evaluations over the past 2 years, yet 
FAA had been unsuccessful in eliminating them. Over 36 deficiencies 
were identified covering proficiency training as well as interfacility 
coordination, transfer of control of aircraft, and effectiveness of air 
traffic management. The Safety Board stated that 

**. . . these deficiencies represent a serious lack of effective management and quality 
assurance . . . and, if not -corrected, could lead to an erosion of safety in the high 
traffic density northeast . . . system." 

Further, the Safety Board said that: 

*'The facts revealed during the investigation of this operational error are yet 
another example where the quality of controller . . . performance is substandard." 
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ContradDr Training at En Route Centers 



In February 1986, faa's Administrator decided that to increase the 
number of full performance level controllers available to control traffic, 
FAA should not use controllers for staff positions such as training, faa 
then decided to contract out the training and automation functions in en 
route centers. 

In April i98o, faa contracted with two firms to provide this controller 
training. One coiitractor was to provide training at centers in the Alaska, 
Eastern, Great Lakes, New England, and Northwest Mountain Regions. 
The other contractor was to provide training at centers in the Central, 
Southern, Southwest, and Western-Pacific Regions. The contracts were 
awarded for about 9 months with options for 2 additional years and 
expired the end of January 1989. During the first year, contractors 
phased their instructors into the centers and started training in October 
1986. 

Among other things, the contractors were required to 

• develop tests, lesson plans, and other course materials using national 
and regional training guidance; 

• develop and administer simulation problems; 

• maintain and manage individual training records, files, and directives; 

• track the certifications of on-the-job training instructors; and 

• participate in students* ratings. 

During 1988, additional changes were made to expand the responsibili- 
ties of these contractors. One contractor was asked to develop a proto- 
type class of refresher and supplemental training for terminal 
controllers in the Eastern Region. On October 13, 1988, this contract was 
further modified to provide on-site training for controllers at 0*Hare air- 
port and its associated terminal facilities. This modification requires the 
contractor to provide 

• classroom and simulated radar training for developmental controllers; 

• supplemental, remedial, and refresher training for all controllers; and 

• computer-based instruction. 

The other contractor was similarly asked to conduct terminal training 
for 18 developmental controllers from Los Angeles and Oakland. 

FAA has continued to contract for training. In June 1988 in response to a 
request from a Subcommittee of the House Appropriations Committee, 
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FAA submitted a plan showing how it could phase out the training con- 
tracts by December 31, 1990. faa's conclusion was that while it would be 
possible to take back these functions, to do so would represent •^a signif- 
icant drain on the controller workforce" and would require additional 
authorized positions and personnel compensation funding. 

On January 31, 1989, faa awL: ded two new contracts to provide con- 
^ troller training. The contracts are for 1 year with 4 optional years. The 
estimated cost for both contracts is about $24 million for each of the 5 
years ($120 million estimated total), faa is requiring, in addition to 
existing provided-training, that the contractors develop simulator prob- 
lems for its en route centers. The cor.tractors will also provide terminal 
training in all faa regions. 
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Selected Questionnaire Results on 
Controller Training 



Figure VI.1: Views on Quftlity of OJT 
Provided to Developmental Controllers 
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Selected Questionnaire Results on 
Controller Training 



Figure VI.2: Center Managers' Views on 
Current Training Contracts 
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Figure VL3: Facility Managers' Views on 
Amount of Simulator Equipment 




Probably to 
Dtflnittly not 
Ad«qu«t« 



Unewtftin 



Probably to 

Dtflnittly 

Adaquata 



Overall Responses 
Center Manager Responses 
Terminal Manager Responses 



Page 29 



30 



GA0/RC£D^9^ FAA Controller Field Training Pmgram 



Appendix VII 



Mayor Contributors to This Report 



Resources, 
Community, and 
Economic 

Development Division, 
Washington, D.C. 



Kenneth M. Mead, Director, Transportation Issues (202) 275-1000 
Victor S. Rezendes, Associate Director, Transportation Issues 
Thomas J. Barchi, Assistant Director 
Frank Bowers, Assignment Manager 



Philadelphia Regional 
Office 



Joseph A. Kredatus, Regional Management Representative 
Brian McCauley, Evaluator-in-Charge 
Kim E. Bennett, Site Senior 
Jill E. Gorman, Evaluator 
George A. Scott, Evaluator 



ERIC 



Page 30 



Ox 



GAO/RCED-SMd FAA Controller Field Training Prognun 



9» 



Kcqucst'sjor copirs ofc.xo n^porls should hv sent lo: 

I .S. (iciUM'al Account in^ ()ri i('<» 
Post OfTicc B<»\ (JOl.l 
(iailluM'shurji, Marxlaiid 2()S77 

TchM)houc 202 277) (;2 n 

The first n\(^ copi<^s of each report arc* free. Additional copies arc 
S2.()() each. 

i'here is a 2r>"u discount on ortiers for 100 or nu>re copies mailed (o a 
single address. 

Orders must be i)re|)aid b> cash (u- 1)> check or mone\ order ina(h' 
out to the Superintendent (d* Document s. 




